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We develop a non-linear framework for describing long-wavelength perturbations in multiple-field 
inflation. The basic variables describing inhomogeneities are defined in a non-perturbative manner, 
are invariant under changes of time slicing on large scales and include both matter and metric per- 
turbations. They are combinations of spatial gradients generalising the gauge-invariant variables 
of linear theory. Dynamical equations are derived and supplemented with stochastic source terms 
which provide the long-wavelength initial conditions determined from short-wavelength modes. So- 
lutions can be readily obtained via numerical simulations or analytic perturbative expansions. The 
latter are much simpler than the usual second-order perturbation theory. Applications are given in 
a companion paper. 

I. INTRODUCTION 

It is a well-established fact that the universe on large scales exhibits a high degree of uniformity. During most 
cosmological eras and for a large span of length scales, it can be well approximated by a Friedmann- Robertson- Walker 
(FRW) spacetime with inhomogeneities described as small linear perturbations around the highly symmetric back- 
ground. This picture has proved particularly relevant for the early universe, as the smallness of the cosmic microwave 
background (CMB) temperature anisotropics indicates. An extrapolation of this observational fact suggests that the 
use of linear theory would also be justified during inflation when the perturbations leading to the CMB anisotropies 
are thought to have been created. So far, almost all studies of the generation and evolution of perturbations in 
inflation invoke the use of linear perturbation theory Q. In principle it offers a tremendous simplification of the task 
of studying the true inhomogeneous spacetime. 

However, even when attention is focused on the inflationary era, linear theory cannot be the whole picture. Since 
gravity is inherently non-linear and the potential of the inflationary model is likely to be interacting, some small 
non-linearity will be endemic to the perturbations. Given the accuracy of forthcoming CMB observations, it is worth 
investigating whether this non-linearity can be observationally relevant. The characteristic signature of non-linear 
effects will be deviations of the primordial fluctuations from Gaussian statistics. In order for this non-Gaussianity to 
be calculated one needs to go to second order in perturbation theory or develop a fully non-linear approach. 

The issue of calculating non-linearity and the consequent non-Gaussianity in the primordial universe has been 
attracting increasing attention recently, although some early attempts to calculate it can also be found in the literature 
. A tree-level calculation with a cubic action for the perturbations has been performed in Q for the case of slow-roll 
single- field inflation (with a similar slow-roll calculation for more general single-field Lagrangeans given in Q). At 
the level of the equations of motion, various authors have pursued perturbation theory to second order p| , with 
providing a review of these techniques. Although interesting results can be obtained at second order, full exploration 
of the system of equations suffers from great computational complexity. On the one hand, the perturbation equations 
tend to be rather cumbersome to derive. On the other hand, gauge-invariant variables, which have proved very useful 
for computations and the interpretation of results in linear theory, are not as simple as their first-order counterparts 
when second-order perturbations are considered. 

In this paper we take a different viewpoint on the study of non-linear perturbations during inflation, systematically 
formulating and extending ideas presented in 0, which incorporate the general multiple-field analysis of 0. We use 
combinations of spatial gradients to construct variables describing the deviation from a spatially uniform spacetime and 
derive equations for these variables on super- horizon scales (section[n|. These variables arc defined non-pcrturbatively 
and are invariant under changes of the time coordinate on such scales (appendix^). They were first used in [jj, where 
we derived a non-linear generalisation of the familiar adiabatic conservation law of linear theory. More recently, the 
authors of [Tol ] used similar combinations of gradients in the context of the covariant formalism \\A\ to also derive 
this conservation law. They showed the relation of these simple, yet fully non-linear, variables to others defined in 
second-order perturbation theory. An equivalent conservation law was derived in [T^] without usin g su ch gradient 
variables. [Another, more recent approach in the study of non- linear perturbations can be found in |l3j. where the 
formalism of is extended and used.] 

In order to include the continuous influx of sub-horizon perturbations to the long-wavelength system, stochastic 
noise terms are added to the long-wavelength equations. For the definition of these noise terms a specific choice of 
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time turns out to be particularly convenient. Thus, we arrive at a set of fully non-linear stochastic equations which 
include both matter and metric perturbations (section llII(l . For actual multiple-field calculations it is more convenient 
to use the explicit field basis of . It is introduced and the relevant equations are rewritten in terms of this basis 
fsection lIV|) . In section fVl we show how the derived equations can be used to extract information about non-linearity 
in inflation. A perturbative analytic approach can be applied giving results to second order. At first order, this 
perturbative expansion is equivalent to the well-known linear gauge- invariant perturbation theory. At second order, 
however, it is much simpler than the corresponding second-order approaches pursued to date. Since the evolution 
equations are fully non-linear on long wavelengths, numerical simulations can be performed without the need for 
analytic approximations. In this paper we concentrate on presenting the methods, and we stress that no slow-roll 
approximation is made here. Detailed applications are provided in separate publications [TH Il6t IT^. 



II. LONG- WAVELENGTH APPROACH 



We start by considering the metric 

d.s 2 = —N 2 (t, x) dt 2 + e 2a ^hij(t, x) dxW , (1) 

where we have fixed part of the gauge by setting the shift, i.e. the got component, to zero. For convenience we 
will keep goi = throughout the whole paper. The spatial part of the metric has been decomposed into a spatial 
metric tensor hij with unit determinant and a determinant part which plays the role of a locally defined scale factor 
a(t,x) = exp[a(t, sc)] 0. The remaining gauge freedom is encoded in the lapse function N(t,x); a choice of N 
corresponds to a choice of time slicing for the spacetime. The vector normal to these time slices is given by no = —N, 
m — and their embedding in the four-dimensional spacetime is characterised by the extrinsic curvature tensor Kij. 
We will use the tensor 

^^V^n^^^e 2 ^), (2) 
which is — (l/3)Kij. The quantity can be decomposed into a trace and a traceless part, respectively, 

H=^-d t a, Ha = -J-e^dthi, . (3) 

N 3 6N 

We now focus on the first approximation we will be employing: the long wavelength approximation [Tgt |20| . (The 
second is the use of stochastic noise terms to describe the effect of quantum fluctuations and will be discussed in the 
next section.) We will be interested in length scales larger than the comoving Hubble radius l/(aH), which are called 
super-horizon, because on those scales one expects non-linearities to build up. (On sub-horizon scales the sources 
of non-linearity, gravity and interacting potentials, do not play a role and linear theory is expected to hold to high 
accuracy.) Consider variations over a characteristic comoving length scale L. For any quantity F(t, x) constructed 
out of metric and matter variables typically we will have dtF = 0(F/L) and dtF/N = 0(HF). From this we see 1 
that for scales L ^> l/(aH) we can expect |^<9i-F| <C |-^<9 t F|. Hence the long-wavelength approximation means that 
we can ignore second-order spatial derivatives when compared to time derivatives. 

From the long- wavelength evolution equation for By we find [Isl 

d t H l j ~ —3NHH i j => H l 3 = C l j{x)^ . (4) 

Here the approximate equality implies second-order spatial gradients are ignored. Hence, B l j is a mode that decays 
exponentially fast in an inflationary universe. From now on we will set it to zero, thereby demanding that hij depends 
on x only, as can be seen from equation @. In other words, hij (which contains the tensor modes) does not participate 
in the long- wavelength dynamics (gravity waves freeze on such scales). For the sake of simplicity, henceforth we will 
ignore the tensor perturbations generated in inflation and consider the spacetime to be close to flat Robertson- Walker, 
thus setting hij(x) = §ij. 



1 As will be explained later, we will choose a gauge in which aH does not depend on x. In this case the statement L ^> X/(aH) makes 
sense globally and not just locally. 
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For the matter sector, we consider a very general inflationary era driven by m scalar fields (f> A with the energy- 
momentum-tensor 

Tfj, u = G A Bd^ A d v( jy B - 9liu (^G AB d x 4> A d x <i> B + V*j , (5) 

with A, B, etc. running from 1 to m and V the potential. The derivative of the fields with respect to proper time is 
denoted by 

n A ^. (6) 

Note that in JSJ we have taken a general field metric Gab and all the equations we give below will be valid for such an 
arbitrary metric. We thus view the dynamics as taking place on a general m-dimensional field manifold parametrised 
by a set of m coordinate functions <p A . Hence it makes sense to define covariant derivatives when considering spatial 
or temporal dependence. For a spacetime-dependent quantity L A (t, x) which transforms as a vector in field space, we 
define the covariant derivatives 

V t L A = d t L A + Y A c d t <i> B L c , V i L A = d i L A + Ti c d i <l> B L c , (7) 

with the symmetric connection formed from Gab- The quantities di<\> B and NII B transform as vectors in field 
space but <fi B does not. Then the long- wavelength equations of motion for this system are 0] 

dH k 2 „ „ R 

dT = -Y Nn * n > (8) 

V t n A = -3NHII A - NG AB V B , (9) 

h 2 = y (l n B nB + yj > (io) 

m = ~^n B d^ B , (it) 



where Vb = ObV = dV/dcf> B and k 2 = 8nG = Sn/m^. We will also use the notation 77 = \J 77s77 B . 

The system of equations l(8jl-Qll|) provides a basis for what has been termed in the past the 'separate universe 
picture' for studying the evolution of perturbations on long wavelengths. According to this picture, each point of 
the long-wavelength inhomogeneous universe evolves like a separate FRW universe. In general, this picture must be 
supplemented by the constraint l|ll|l which connects the separate universes together. Only when the scalar fields are 
all slowly rolling can the gradient constraint (|11|) be ignored, since in this case it can be obtained from the Friedmann 
equation (|10(l with the 77 2 term dropped and the field equation © with the left-hand side set to zero. However, we 
will not make any slow-roll assumptions for the formalism we develop and hence we keep both 1|1(J[) and Ijlljl . All 
formulae in this paper are valid regardless of slow roll. 

Equations (|S|l- lll|) can be reformulated in a convenient way to make easy contact with the well-known theory 
of gauge-invariant linear perturbations, but which is fully non-linear. In the separate universe picture deviations 
from uniformity can be described as differences in the properties of 'neighbouring universes'. It thus makes sense to 
consider spatial gradients in order to describe perturbations. The use of spatial gradients was first advocated in [Tl| 
in the context of the covariant formalism. Here we consider two spacetime scalars A and 73, and define the following 
combination of their spatial gradients: 

C % = diA -^-diB, (12) 

as in 0,0. We show in the appendix that under long- wavelength changes of time slicing (t, x) — > (t, x), 

C<=V-C 3 , (13) 

which means that such combinations of spatial gradients are invariant under these specific coordinate transformations. 
One such quantity that will be very useful is [jj 

Qt = e a (d i <P A -^d i a\ (14) 
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(the fact that a transforms as a scalar is also shown in the appendix). Note that when linearised around a homogeneous 
background, Q A is just the gradient of the well-known Sasaki-Mukhanov variable 0,0 



ftfn = a(t) 5(f> A + 



N(t)H(t) 



(15) 



where \t is the perturbation in the trace of the spatial metric. Recently, the authors of 01 used similar combinations 
of gradients in the context of the covariant formalism for a single fluid and showed that second-order gauge- 
invariant variables given in the literature can be derived from them. Since they are non-perturbative, presumably 
they exhibit gauge invariancc to all orders in the long-wavelength approximation. 
From l|5)l- lfTTll an equation for Q A can be derived @]: 




with the "mass matrix" 



V £ 



DCB ' 



n n 



-{2-1)5' 



(NH) 2 n A B Q? = 0, 



21 



(3 



1 n n 



El 
n 



VB 



(16) 



(17) 



where V A B 
define 



G AC V B Vc = G AC (dBVc - rf c VD), and R A dcb is the curvature tensor of the field manifold. We 

3Hn A + G AB V B 



Yh 2 



nn 



A _ 



v A B n b 
h 2 n 



+ 3 e—-3fj 



(18) 



In the absence of stochastic source terms (see next section) the relations H18[) are equivalent to the standard definitions 
of the multiple-field slow-roll parameters (where one should read (l/N)V t instead of I?) by using JSJ and © and 
its time derivative. If a slow-roll approximation were to be made, e and fj A would be first order, while £ A would be 
second order. However, we stress again that no slow-roll approximation is made in this paper, so no restriction is 
placed on the magnitude of e, rj A , and £ . Equation (|16|) describes the full non-linear dynamics on long wavelengths. 
Although it looks linear in Q A , its coefficients are spatially dependent functions which depend implicitly on Q A (see 
7] for details). It is valid for any choice of time slicing. 

Equation (|16|) easily connects with linear perturbation theory, since its linearised version is the spatial gradient of 
the linear equation for q A n p| in the long-wavelength approximation. For our purposes another variable will be more 
convenient than Q A . We define 



I'll 



(19) 



which when linearised is just the spatial gradient of the well-known comoving curvature perturbation Just as Q A , 
the variable £ A is invariant under choices of time slicing within the long- wavelength approximation. 2 Expressing the 
long-wavelength evolution equation (|16f) in terms of Q A we get 



with 



V A 



B 



H 2 
-21 



N 
N 



- 2NH 




21 



n n 

n A n R n A 



{NHf~ A B £ =o, 



— — + ( Z~e + 3r?H + 2l 2 + 4erjfll + {^f + I 1 

n B 



(3 + i) — — + —VB+ V A — 

y 'nn n' B I n 



(20) 



S A , 



(21) 



2 We note that we can write (77^/77)^ = dia — (dta/dtp)diP, where p is the energy density of the scalar fields (here we have used 11 41 . 
the definition of e in 1181 . 1111 . 1101 in the form H 2 = K 2 p/3, JSJ, and This shows that in the long-wavelength approximation the 

variable used in is identical to the component of our parallel to the field velocity, i.e. its single-field version. 
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and 



-11-^- 



n A n B \ _ B 

B TP J 



II = 



n A Vab n B 
n h 2 n 



(22) 



Since the coefficients appearing in 1|20|) arc spatially dependent, a set of constraint equations is needed to close the 
system [2j: 



d_ 

df 



-=-&a = -NHid l a + Hd t N + NHi^-( A 



n 



n A , A 



K \ 11 



and 



v,n A = 



/2e 



i? 



(23) 
(24) 

(25) 
(26) 



With these constraint relations the spatial derivative of any quantity of interest can be calculated in terms of C, A 
and its time derivative, for a given choice of time slicing (i.e. the lapse function N). Equation (|20|l along with the 
constraints H23|) - (|26|l are the main results of this section. 

For single-field inflation an important result can be obtained immediately, since in that case E A r in l|2(J|l vanishes 
identically. E a b = 0- Hence. Q is seen to be conserved in single-field inflation, as was first shown in 7, 9]. The authors 
of ^3 recently reached a similar conclusion. With a choice of time slicing which sets 3$ = 0, Q = c^a corresponds 
to the gradient of the integrated expansion a(t, x) = J NHdt of different points. So, in single-field inflation the 
difference in the number of e-folds of the separate universes is conserved. The conservation law has been formulated 
in these terms in fl2l| . 

Before closing this section we would like to make a few remarks on the '5N formalism', which has been used in 
other, more recent work (see e.g. ^3|) 3 as an alternative for studying non- linear perturbations. In this formalism 
the perturbed expansion a(t,x) on comoving time slices is related to the perturbations of the scalar fields 5(f> (x) 
on an initial flat time slice where the perturbations are supposed to have been generated after horizon crossing. In 
our notation Sa(t,x.) = d~ 2 di ((TT^/TJ) Q 4 ) since (TT^/TT) ( A = d^a on comoving time slices. All calculations in the 
SN formalism are based on the knowledge of a(t, (f> A (xj), i.e. the local expansion expressed in terms of the initial 
fields at each spatial point. All the initial scalar field values which appear in this solution are then made spatially 
dependent. Practical calculations require an accurate multi-dimensional solution for the expansion a(t, <ft A ) of the 
homogeneous universe, from which all its field derivatives can be derived. Furthermore, this entails the approximation 
that the momentum dependence is completely ignored, since in general a(t, <p A , II A ) is a function of both the fields 
and the momenta. The conditions for such an approach to be valid can be seen from i(5|)- (|llfl . Since the evolution 
equations on long wavelengths are the same as those of a homogeneous cosmology valid locally, any analytic solution 
of a homogeneous universe with the initial conditions made spatially varying will provide a solution describing the 
evolution of the true inhomogeneous spacetime. The initial conditions must satisfy both of the constraints l|l(Jfl and 
(fTTfl . In H3 equation (JTTJ is ignored, which is the same approximation as ignoring the momenta (see the discussion 
below Ullfl ). These conditions restrict the type of multiple-field models that can be investigated. In contrast, the 
formalism presented here is applicable in a practical way to any expansion history, slow-roll or otherwise, and it is 
tractable numerically when analytic solutions cannot be obtained in full. 



III. STOCHASTIC EQUATIONS 

In the previous section we derived equations for the long- wavelength evolution of the variables C, A defined in l|19ll . 
These are (|2U|1 along with the constraints l|23|l - (|26|l . In order to solve this long- wavelength system initial conditions 
must be provided. In inflation these originate in the short-wavelength quantum regime, before the fluctuations in 



3 Note that in these other works 7V(t,x) is the local expansion, not the lapse function. In our notation it would be the 'Set formalism' 
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the metric and matter cross the horizon, so we have to incorporate these sub-horizon effects in our iong-waveiength 
equations. Wc achieve this in the following way. Once super-horizon, the quantum fluctuations can be considered 
as classical stochastic quantities. This is the stochastic picture for the generation of inflationary perturbations [2lj . 
Linear theory is used to describe the perturbations until shortly after horizon crossing. These are then used in 
stochastic source terms as the initial conditions for the full non-linear long-wavelength system. A smoothing window 
function is used to separate short and long wavelengths as in 0- However, improving on Q, we start from a first-order 
system, in order to correctly reproduce the velocity modes as well. We also note that in many references on stochastic 
inflation, metric fluctuations are not consistently included. They are included in our formalism. 

For the definition of the source terms it is convenient to fix the remaining gauge freedom (N) by choosing r = \n(aH) 
as the time variable. 4 One advantage of this gauge choice is that horizon crossing of modes (k = aH) happens 
simultaneously throughout the whole universe. Other advantages will become clear below. For this choice we have 



NH 



1 



(27) 



and our basic equations l|2l)[). 12411 l|2tj|) read (note that l|23|) is no longer an independent equation) 



3-2e~ + 2 ? ?ll~3g 2 -4gryll A 



a b Q = . 



(I -If 



(28) 



with 



d t a = 
d % <b A = 



e n A aA 



/2e 

K 



S A ! 



i n A n B i >s 



l - e n n 



Si i 



(29) 
(30) 



and 



v i n / 



'21 



-H 



n A n, 



~ A n B 



n n i 



n 



(31) 



Defining the velocity 9f we express the dynamical equation H28JI as 



v T (f -ef = o 



277II - 3? 2 - 4er?H 



(1-e) 



^2 



(I-?) 2 



—A /-B 







(32) 



We then add to the right-hand side of these equations stochastic source terms to emulate the continuous influx of 
short-wavelength modes when they cross the horizon, in this way setting up the proper initial conditions for the 
long- wavelength system. The derivation of these source terms goes as follows (for more details see 0)- We start 
from the exact (i.e. no long-wavelength approximation) equations for the linear theory, written as two first-order 
differential equations like l]32p. We define smoothed long- wavelength variables using a window function W. In Fourier 
space this means £ A n [w (fc) = W(fc)Cj^ n (fc), and an identical expression for 9 A . Rewriting the exact linear equations in 

terms of the smoothed variables df n i w , one is left with terms that depend on the non-smoothed variables Cif n - These 
terms together form the source, and are put on the right-hand side of the equations, while the other terms are on the 
left-hand side. At the linearised level these equations are still exact. Next, in order to go to the non-linear case one 
uses the fact that the left-hand side is exactly the linearised version of the long- wavelength system (|32|) . It is then 
postulated that the right-hand side can be taken as the source term for the non-linear long-wavelength equations, if 
one replaces all background quantities with their fully inhomogeneous versions. The final result is: 




(l-e~)2 



- bQ 



(33) 



4 This is a useful time variable as long as it is monotonic, a condition that is invalid only around reheating. Since the source terms have 
disappeared by then, a different choice can be made near the end of inflation. 
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with the source terms S A and J A given by 



d 3 k f d 3 k 

■ W{k) df n (fc, x) ik t e ik x + c.c. , J A = — ™ W(fc) <(fe, z) ifc, e ifc * + c.c. , (34) 



(2tt) 3 / 2 v /MlnV ' ; 1 ' 1 ~7 (2tt) 3 / 2 

where c.c. denotes the complex conjugate and £jf n and 8 A n are the full, non-smoothed solutions from linear perturbation 
theory, that is, incorporating short-wavelength information. The fact that they depend on x as well as on k represents 
the fact that all background quantities in these solutions should be made inhomogeneous. 
The following relations hold: 

Cii=^9ifn, <=^rCif„, q A n (k)=Q A nB (k)a B (k), (35) 

ay 2e 

where q A n is the solution from linear theory for the Sasaki-Mukhanov variable l|15f) . In other words, Q A nB (k) is the 
solution of 

1 - 2? - ( 2 - 2S7II _ . n A c ^ c k 2 



where all coefficients take their homogeneous background values and with initial conditions deep within the horizon 
Q A nB (k) = U A B /V2k and T> T Q A aB (k) = l/[aH(l - e)] i y / k/2U A B , where U A B is a physically irrelevant unitary 
matrix. Then the sources can be written as 

S A = --j=j ^0^W(k)Q A nB (k)a B (k)ik t e ik - + c.c., 



K 



d 3 k 



a a (fc)ifc ie lfca: + c.c. (37) 



Following [3 we have introduced a set of complex Gaussian stochastic quantities a A (k) to replace the quantum 
creation and annihilation operators, satisfying 

{a A {k)a* B {k')) =S A B 5 3 (k-k r ), (a A (k)a B {k')) = 0, (38) 

where (. . .) denotes an ensemble average. This is why the source terms are called stochastic. Because Q A and 9f now 
represent smoothed, long-wavelength variables, it is clear that they have to be zero at early times when all the modes 
are sub-horizon: 

lira ( A = 0, lim 9 A = 0. (39) 

r — > — oo r — > — oo 

The appropriate short- wavelength initial conditions are then introduced into the system later via the stochastic source 
terms. 

The linear perturbation equation l|3()|) can either be solved exactly numerically to obtain Q A nB , or analytically 
within the slow-roll approximation. The latter was done in [g. From that analytic slow-roll solution one finds that 
T> T Q A nB = D A cQy lnBl with D A c a matrix containing slow-roll parameters (given explicitly in 8]), and Q A nB = 
c/(2k 3 / 2 R) S B + first-order slow-roll terms (omitting physically irrelevant overall unitary factors). Even though in 
this paper we make no use of the slow-roll approximation whatsoever, for applications of the formalism it is useful 
to observe that this means that, in our gauge, non-linear corrections to Qu n are higher order in slow roll and can be 
neglected in a leading-order treatment. (This reflects the fact that q, not is the proper well-behaved quantity to 
use on short wavelengths.) Hence in such a treatment the only quantities that have to be made inhomogeneous in the 
source terms (|37fl are the matrix D A c and the \/{a\/2i) prefactors. This point is explicitly worked out in pjLll^|. 

We can take the Fourier transform of the window function W(k) to be a Gaussian, 

W{k) = c - k2R2 / 2 , R =^ =ce -r ) ( 40 ) 

atl 

with R the smoothing length above which the system is considered to be 'long wavelength'. We take it to be 
a small multiple of the comoving Hubble radius, since the latter is the natural scale that separates short and long 
wavelengths in inflation; c « 3-5 will do for our purposes. Since the smoothing length is decreasing quasi-exponentially 
during inflation, more and more modes will populate the long-wavelength system. For our choice of window function, 
VV(fc) = (kR) 2 W(k), where a dot denotes a time derivative with respect to r = In(aH). If the smoothing length R were 
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constant, Sf and J A would be zero. Note that with our choice of time the smoothing length remains uniform across 
space even in the presence of perturbations. Had we not made this choice any mode would enter the long-wavelength 
system at different times for different points in space, which would complicate matters. The system of equations l|33[) 
along with the constraints l|29|) - (|31[) (where T> T (f is replaced by Of) forms a consistent and self-contained system of 
non-linear stochastic equations and is the main result of this paper. When linearised it is exact and reproduces the 
well-known gauge-invariant linear perturbation theory y|. 

At first sight it might seem that any results obtained from solving (|33[) will depend on the ad hoc choice for the 
window function W. It turns out that the exact form of W is for the most part irrelevant. At linear order there is 
no dependence of the final results on the exact form of W, by construction; any properly normalised function with 
VV(fc) — * 1 for scales sufficiently larger than the horizon will produce the same final answer. Beyond linear order there 
is some dependence on the choice of W, but this dependence is limited to terms that involve only non- linear effects 
around horizon crossing, which turn out to be small and hence uninteresting observationally. The non-Gaussianity 
in single- field inflation is an example of this, see |15| . but even here only the limit with all three momenta of the 
same order is affected by the choice of window function. On the contrary, any effects which involve super-horizon 
evolution are independent of the functional form of W for scales sufficiently larger than the horizon. We discuss these 
issues in greater detail in |16U17|. where we also show that such super- horizon evolution effects can lead to potentially 
observably large non-Gaussianity. 



IV. FIELD BASIS 



So far we have used a field component notation, with indices A, B, etc. labeling the fields. However, in actual 
analytic multiple-field calculations it is more convenient to work with a certain explicit basis on the field manifold, 
which allows us to clearly distinguish effectively single-field effects from truly multiple-field ones, to work again with 
normal time derivatives instead of covariant ones, and which is also a necessary ingredient for quantisation. This basis 
was first defined in [22^. and is also described in p|. 

The first basis vector ef is the direction of the field velocity. Next, ef is defined as the direction of that part of the 
field acceleration that is perpendicular to ef. Hence, 



1 " n ' 62 " \v t n*-efe 1B v t nB\- 



One continues this orthogonalisation process with higher derivatives until a complete basis is found. Explicitly 



(p ± \ A (J-Ti \ m ~ n B m 
m = wu± ^A n^r-i n-Bi ' K p m) B = e m e mB , {P m ) B = 6 B - }_^{P q ) b- (42) 

Here the projection operators P m project on the e m , while the P^ project on the subspace that is perpendicular to 
ex, ... , e m , and we define (Pq~) A b = S B . The basis is orthonormal: e^e nA = 5 mn . Now one can take components of 
vectors in this basis and we define, for example for (f, 

C^e mA Ct (43) 

Note that, unlike for the index A, there is no difference between upper and lower indices for the m. The slow-roll 
parameters 77" and f] 1 - given in (|22(l are now simply 77" = e^f/A and f] 1 - = e A f\A (by construction there are no other 
components of fj A ) and equivalently £" = e A ^A- The definitions 12211 can be rewritten as (including e for completeness' 
sake) 

e-^ jjll-_ 3 -?L^ i^f ^-{efVA? n , „ ejV AB e* 



5 Again, as in the definition of the slow-roll parameters, using and its time derivatives one can rewrite all time derivatives of TI A in 
terms of Tl A itself and field derivatives of the potential, and define the basis vectors in that way. However, once the stochastic source 
terms are included, equation J5J changes subtly and the two ways of defining the basis vectors (except for e A ) are no longer equivalent. 
At that point it is actually the second way that is our real definition, but since those equations are rather awkward and have to be 
written down for each value of m separately, we give here the compact definition in terms of time derivatives of II A . 
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Finally we define for later use 

Z mn = -ttjj e mA D t e^. (45) 

It is antisymmetric and only non-zero just above and below the diagonal. If a slow-roll approximation were to be 
made, it would be first order in slow roll. Its explicit form in terms of slow-roll parameters can be found in |8( ; up to 
m,n = 3 the only non-zero terms are Z i2 = —Z 2 i = —fj and Z 23 = —Z 32 = ~^3/v' L - 
The equation of motion l|28[) for (f can now be rewritten as an equation of motion for 

■Am , f (3-2e + 2fi\\-3e 2 -4i^)6 mn 2Z mn \ ■ E mn _ 

Q + { + y— rj Q - 0. (46) 

where = ^(Cf 1 ) = ~§r( e m A(f~)> with r the time variable defined in and with 

S mn = -^p^ - ^i? TO iin + (1 - e)Z m „ + Z mp Z m + ^3 - 21 + 277" - e 2 - 2S7 11 ) (47) 
+ (3e + 3t?U + 2e 2 + 4SjU + (t^) 2 + fU) <W - 2? ((3 + e~ + 2^)5 ml 6 nl + f,^{5 ml 5 n2 + 5 m2 5 nl )) , 

where R m iin = e^R AB cDefe^e^ and V mn = e^V AB e^. Tne matrix 3 m „ is not just e^EUsef , but contains 
additional Z mrl terms. Note that Sn = identically, which means that in the single-field case S is zero, and hence Q 
conserved on long wavelengths, as we mentioned before. In a procedure completely identical to the one described in 
the previous section, we can then split the second-order differential equation into two first-order equations and add 
stochastic source terms to find the analogue of (|33|) : 

Qm qui ^V 1 

! (3-2£+2ryll - 3^ - ief]\\)6 mn 2Z mn \ n „ , E mn m ^ m (48) 



(l_g)2 1 1 (i-g)2'« 

where the source terms <S|" and ^7™ are defined analogously to (|3"4*|l with (([^ and instead of £if n and 0jf n . It is 
important to realise that for a velocity, like #™, the relation between 0™ and 9f is not simply a contraction with the 
basis vector, since the time derivative of the basis vector has to be taken into account as well. They are related by 
Qf = e mA Qf-NHZ mn Q. 

Of course 148|) has to be supplemented with the constraints (|29[) - (|31[) . From these constraints and the definitions 
(|44H we can derive the following expressions for the spatial derivatives of a, H and the slow-roll parameters: 

di In a = — di In H = — ^ 6 - (1 , 

dfe = -2e((l-£tf + i±^tf-rt a ), 
d^ 11 = (1 - e) ((3 + ^1)0* - V^fj - ((3 + *?«)(£ - »?«) + (^) 2 - §i) - (3 + e + 2^)^ 

+&cf+y;fecr, (49) 



n>2 



(1 - ?) + (3 + ryll)0 2 ) + J_ f (3 _ e + 2^ + |§) + ((3 + *j")(c + ^) - (^) 2 ) £ 



' n>2 



When no stochastic source terms are present, or when all slow-roll parameters take their homogeneous background 
values, the relation V\ n j H 2 = (3e — 377" — £")<5„i — {Sfj 1 - + £2)^712 — £,3^3 can be used. This relation is derived by 
taking the time derivative of © and using the definitions of the slow-roll parameters. Let us reiterate that all these 
expressions are not slow-roll approximated, even though they contain slow-roll parameters. The equations in this 
section will be the basis of more detailed multiple-field calculations in jig. 
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V. APPLYING THE FORMALISM 



The closed system of non-linear equations for £ A is, in principle, amenable to direct numerical solution on a multi- 
dimensional spatial grid. However, the inhomogeneous coefficients in (|33|) have an implicit dependence on , meaning 
that a(t, x), (f) A (t, x) and II A (t, x) need to be reconstructed from the constraints l|29[) ~ H31[) a ^ each timestep. Now in 
the long-wavelength approximation and in the absence of noise, the (, A equation plus the constraints are equivalent 
to the separate universe equations i|S|)- i|ll|) from which they were derived, that is, the original evolution equations for 
a(t,x), 4> A (t,x) and II A (t 7 x). Numerically, it turns out to be simplest to solve the ( A equations by supplementing 
them with the separate universe equations, so that the inhomogeneous coefficients depending on a, (f> A and II A are 
given explicitly, rather than being reconstructed from <^ A . (The redundancy entailed in this can be viewed positively, 
since it gives a check on the accuracy of the finite difference scheme through the relations Ijl4(l and Ijl9(l .) 

In order to add the stochastic noise on the right-hand side of (|3"3")l , we evaluate the mode functions of the /c-dependent 
linear perturbation equations to high accuracy, beginning with flat-space initial conditions well inside the horizon (no 
slow- roll approximation is made). As in other stochastic approaches, a realisation of the linear perturbation solution 
q A n (k, t) is then constructed by multiplying random numbers satisfying (|38[) for each k on the numerical grid by the 
corresponding mode function for k — \k\. At a finely-spaced set of times, the linear perturbations q A n (k, t) are convolved 
with the window function W(fc) to determine the necessary long- wavelength correction §Q A {x, t)5t in real space, where 
St is the timestep. Since any change 5C, A necessarily entails changes to a,<f> A ,II A , the corrections Sa,5<p A ,dn A also 
need to be determined from the constraints Ij29(l - I|31|l . The procedure then iterates through successive non-linear 
evolution and stochastic noise updates. Results from the successful numerical implementation of these equations in 
single- and multiple-field inflation contexts will be presented elsewhere. 

Up to this point, the only approximations that have been made are the basic assumptions of the method: the 
long-wavelength approximation and the construction of the stochastic source terms for the non-linear equations. The 
equations are otherwise completely general, that is, non-linear and no slow-roll approximation has been made. As 
discussed above, with a numerical treatment we can proceed directly with these equations. However, when we want 
to use the formalism to make explicit analytic calculations, we need to make two expansions: a slow-roll expansion, 
and an expansion in perturbation orders. Of course in practice these expansions have to be cut off at a certain 
order, which means that two additional approximations are introduced. We will not discuss the slow-roll expansion 
here, but describe in general terms how a perturbative expansion can be set up. We find that compared to standard 
perturbative approaches [5j the equations are much simpler to derive and use. Detailed applications are presented in 
separate publications [TBL Il6t lr^| . 

The general form of the system of non-linear stochastic equations with the constraints is 

V T Vi + A(u)vi = Qi{u), diU = C(u)vi . (50) 

We use the vectors Vi = (C/ 1 , 0f) T and u = (a, 4> A , II A ) T and Qi = (S A ,J' A ) T (where T denotes the transpose) to 
simplify the notation. The quantities A and C are matrices, functions of the components of u, which can be read off 
from (|33l) and l|29|) - (|31[) . Now everything can be expanded as 

«i = + vf ] +..., u = + v.™ + + ... (51) 

Note that u,; does not have a zeroth-order spatially homogeneous background part. At first order we have 

V T v^ + At%P = Q?\ d iU W = . (52) 

The first equation is linear in wj 1 ' and can be solved since the background solution and the linear source term 
are assumed to be known. The procedure is equivalent to standard gauge-invariant linear perturbation theory. With 
this solution the constraint can then be solved for u^: 

«« = c^r 2 ax (1) . (53) 

It is now straightforward to obtain the second-order perturbation equations: 

V T vf> + A^vf = gf - A^vf\ d lU ^ = cWvW + C^vV. (54) 

Here A^ is given by 



du J 



(55) 
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and similarly for and Q\ . We see that the equation of motion for vf is again linear, with the right-hand side 

(2) 

known from the solution at hrst order, and it can be solved. Again, given the solution for v\ we can then solve the 
constraint for u^ 2 ': 

u (2) = C (0) d -2 d i v (2) + d -2gi . (56) 

Knowledge of and u^ 2 -* gives which in turn determines u^ 3 \ etc. Continuing in this fashion one can in 
principle obtain all quantities of interest to any desired order. Even though the discussion in this section might seem 
rather abstract, we show in p^lll6tll7| that this approach works well in explicit calculations. The expressions on the 
right-hand side of l|54|l are relatively simple to derive, which makes the calculations tractable. 

VI. SUMMARY 

In this paper we described a scheme for studying the non-linear evolution of inhomogeneities during multiple-field 
inflation, extending ideas presented in pj. Here we summarise the main ingredients of the formalism, (i) We advocate 
the use of variables like (f, defined in (|19|) . using spatial gradients to describe deviations from a homogeneous 
spacetime. These variables are invariant under long-wavelength changes of time slicing and include both matter and 
metric perturbations, (ii) We derived a set of exact, non-linear, long-wavelength evolution equations for (12011 . To 
close the system, a set of constraints (|23[1 - <|26[) determines all local quantities appearing in the coefficients of 12UII . An 
obvious consequence of these equations is that for single-field inflation the variable is exactly conserved. (Hi) In 
order to incorporate the influence of short-wavelength quantum modes, stochastic sources are added on the right-hand 
side of the evolution equations, leading to (|33[) . (|34[1 . When linearised, the equations are exactly equivalent to linear, 
gauge-invariant perturbation theory. We also introduced the field basis of |8j and rewrote our equations in terms of 
it, which is very convenient for actual multiple-field calculations. The full stochastic system is derived without any 
slow-roll approximations and is well-suited for numerical simulations. If slow roll is assumed, analytic results can be 
obtained via perturbative expansions. The merit of perturbing this set of non-linear equations for the variables C,^ is 
a significant simplification compared to the standard approach of perturbing the Einstein equations from the outset. 
This paper concentrated on describing the method, while quantitative calculations using this formalism are given in 
related publications 0, 0, . 
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APPENDIX A: CHANGING THE TIME SLICING ON LONG WAVELENGTHS 

In this appendix we demonstrate that (|12f> is invariant under changes of time slicing. Again, we restrict attention 
to metrics like which do not mix temporal and spatial intervals. The transformations we consider are defined by 
going to a new time slicing t — * t(t, x) and then fixing the spatial coordinates by demanding that — 0, that is, 

making the coordinate lines 5? = const, normal to the t = const, hypersurfaces. We show, following [l^, that, up to 
second order in spatial gradients, the spatial coordinates can be taken to transform trivially. 

Suppose we are interested in a patch of spacetime which at early enough times is homogeneous, in accordance 
with the initial conditions, that is, the comoving horizon is initially taken to be larger than the spatial extent of the 
patch. Perturbations are introduced later as wavelengths shorter than the spatial region of interest exit the horizon. 
While the patch is homogeneous, there is a preferred time slicing which respects the spatial symmetries, and spatial 
coordinates are chosen on these initial time slices. After perturbations are introduced there is no preferred choice of 
time slicing. Hence one should consider the consequences of changes t — > t(t, x), for example between uniform field 
and uniform expansion time slices. To define the new spatial coordinate lines we demand that the curves x J — const, 
be the integral curves of w 11 with 

dr^ 

w» = -— =dH. (Al) 
as 

Roman indices run from 1 to 3 and Greek from to 3. The vector is normal to the t = const, hypersurfaces. For a 
displacement along its integral curves Sx^ = d^tSs, where s is an arbitrary parameter. For such a displacement 5x^ 
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we have St = d^tSx^ = d^td^tSs. Therefore, the time-time and space-time parts of the transformation are defined 
to be 



dx^ 



at dadn 



(A2) 



by eliminating ds in lAlfl . We can now derive the time-space and space-space parts. Defining A M ~- = dx^ 1 jdx, 3 , 
consider another displacement fe M on a i = const, hypersurface: 



Sx^d^t = . 



(A3) 



Writing Sx^ — A M ^ Sx l (St is zero for this displacement), we find from (|A3|) for an arbitrary Sx l that 



W-jdyt = 



A o = iv j ° tl 
3 d t t 



(A4) 



So, we need to specify only the A 4 j part of the transformation. Integrating equation (|A2|) along a x 3 = const, curve 
gives 



x 3 = f 3 (x l ) + / dt 



dH 
djdn 



(A5) 



with p some arbitrary function depending on the initial labelling of the new spatial coordinates. Since at early times 
spacetime is homogeneous, useful time slicings are those coinciding with the preferred one initially, t = t = i pre f. 
Hence it is natural to consider spatial coordinates that reduce to the preferred set on these initial time slices. We 
thus take f 3 {x l ) = 8 3 ix l . Of course, we could perform an arbitrary spatial transformation, but on long wavelengths 
it would be independent of time, as shown in Given this result, equations (121 H and 123|l - l|26|) are covariant under 
such a transformation. Taking a spatial derivative of I|A5J| with respect to x 3 \ using the chain rule and l|A4jl . one 
arrives at 



dit 



5h + it dt 1 



d 3 t 



d v td v t 



- r -dl / dt 



.- d 3 t 



djdn 



A 1 1 = S 3 



k ' 



(A6) 



so that 



(di 



(A 



(A7) 



The full transformation has now been specified. With these formulae one can verify that the metric in the new 
coordinates reads 



Wc note that time derivatives transform as 



2& ^h T Ax) = <5V fe 5 e 2a(t ^h kl (x) , g s = , N = N/d t t. 



(A8) 



(A9) 



Under these long-wavelength time-slicing transformations the determinant of the spatial metric, exp[2a], transforms 
as a spacetime scalar. Hence, it is easy to see that a variable like ijT^ . in particular lfT4l) . is invariant under these 
changes. 
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